|
|
Dear Willin, Could you please check this ticket? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, 1.For the TSTV tool, we will download it and upload it to the FTP directory. 2. Regarding the GMS for SWAM, I can first upload the GMS to the FTP, and then you can merge and test it. we have not had access to the SWAM source code directory with our account, so we haven't downloaded or compiled it's firmware. 3. Since October 28, we have also been unable to access the SKB network via VPN, and the same applies to SMART3. BR. Willin |
|
|
Hello, Willin, 1. I can download the TVTS tool, you don't need to download it. 2. Okay, please update it. 3. Which account are you using ? There is an issue on our network, so I reset our routers. Please let me know your account for VPN, I will set it again. Thank you. Sangmin Choi. |
|
|
Hi Sangmin, I received your message, so I will not download the TVTS tool anymore. However, regarding the update of the GMS for SWAM, there are still issues if you could help us reactivate the VPN or SKB account: 1.We do not have the SWAM code, and based on historical experience, a complete download will take about a week or longer. 2.Only Downloading the GMS directory separately is expected to take around 4 hours or more, possibly a full day. 3.I tested the VPN this morning, and it is still not functional. 4.The SKB account has also been inaccessible for 2 months and is likely deactivated (bp_willing.jw.deng). 5.The last update for the GMS on OS 10 was on 2024/10/22. The update log is attached in the screenshot; please check if it contains the information you need. The fastest way to update this version of GMS today seems to be for me to upload it to FTP, and then you can merge it into the specific branch. Please inform us of the FPT directory for the upload. BR. Willin |
|
|
Hello, Willin, Okay, please upload GTVS packages to ALT FTP server. /GoogleTool/ATV10/gtvs_update/20251230 I will merge it. Thank you. Sangmin Choi. |
|
|
the latest gtvs for OS 10 name: google_gtvs-refs_heads_q-tv-r1-fs-dev.tar.gz md5sum: 8a6dc6bcc3ee6655f194eac188a7448e it will be upload when the OS12 GSI tools was uploaded |
|
|
Hello, Willin, $ md5sum google_gtvs-refs_heads_q-tv-r1-fs-dev.tar.gz 8a6dc6bcc3ee6655f194eac188a7448e google_gtvs-refs_heads_q-tv-r1-fs-dev.tar.gz $ aapt dump badging google/apps/PrebuiltGmsCorePano.apk package: name='com.google.android.gms' versionCode='242632116' versionName='24.26.32 (080306-650348549)' platformBuildVersionName='VanillaIceCream' platformBuildVersionCode='35' compileSdkVersion='35' compileSdkVersionCodename='VanillaIceCream' sdkVersion:'21' targetSdkVersion:'34' I downloaded google_gtvs-refs_heads_q-tv-r1-fs-dev.tar.gz, but the apk version is same as before. Could you please check it again? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, The latest release of PrebuiltGmsCorePano.apk was on "Tue Jul 16 09:00:26 2024 +0000," and the log shows the following pictures,by Version code still is 242632116 some other apk updates,they uploaded to the same dir, file name:"google_gtvs-refs_heads_q-tv-ref-release.tar.gz",md5sum:3aa12b965801d0e635a6c6424adbad99 image.png (215,684 bytes) image-2.png (235,235 bytes) |
|
|
Hello, Willin, How can I run the TVTS for swan ? Could you please check it with 3PL ? TVTS 2.16_R2 can't be executed if com.google.android.gms version is 242632116. Thank you. Sangmin Choi. |
|
|
Hi Sangmin, We have communicated with the 3PL, and they mentioned that using R1 can pass the test. For R2, our account is unable to access the latest GMS version. We have already reported this issue to Google, so please be patient. Additionally, if possible, trying the R1 version for testing might be quicker. Google issue url: https://partnerissuetracker.corp.google.com/issues/472375506 |
|
|
Hello, Willin, Okay, I will run using TVTS 2.16_R1 for swan now. Please let me know if there is any update at issue tracker. Thank you. Sangmin Choi. |
|
|
Hello, Willin, Unfortunately, TVTS 2.16_R1 can't be executed. 01-06 11:54:07 E/TestInvocation: Expected Version Code higher then "15012902" but found "15000514" for Package: com.google.android.katniss Please update the application and run TVTS [SKBFXYWR0LXP sequoia:bfx-ua300 QT] com.android.tradefed.targetprep.TargetSetupError: Expected Version Code higher then "15012902" but found "15000514" for Package: com.google.android.katniss Please update the application and run TVTS [SKBFXYWR0LXP sequoia:bfx-ua300 QT] com.google.android.katniss versions you shared are 15001332 and 15003555. aapt dump badging google_gtvs-refs_heads_q-tv-r1-fs-dev/armeabi-v7a/google/apps/Katniss.apk | grep versionCode package: name='com.google.android.katniss' versionCode='15001332' versionName='7.15.20240818.2' platformBuildVersionName='VanillaIceCream' platformBuildVersionCode='35' compileSdkVersion='35' compileSdkVersionCodename='VanillaIceCream' aapt dump badging google_gtvs-refs_heads_q-tv-ref-release/armeabi-v7a/google/apps/Katniss.apk | grep versionCode package: name='com.google.android.katniss' versionCode='15003555' versionName='7.17.20241027.9' platformBuildVersionName='Baklava' platformBuildVersionCode='35' compileSdkVersion='35' compileSdkVersionCodename='Baklava' Could you please help me again ? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, The 3PL said that the beta program account has the permission to view the latest version of katniss. We have submitted an application for beta program account and are waiting for the Google's review. We have no SWAN device. Could you provide gmail.com account? We can use you account to apply permission to access beta releases of new Google TV and Android TV apps to test on you devices before the apps are released to the public. So you can try to login your account and download the latest APP for local test. |
|
|
Hello, Willin, I have the GTVS beta program account and TVTS 2.16_R1 is started using this account. If I can get the pass report using GTVS beta program account, is it okay to get self MR approvement ? Anyway, TVTS 2.16_R2 can't run even I use the GTVS beta program account. Please keep checking the GTVS package update for SWAN. Thank you. Sangmin Choi. |
|
|
Hi Sangmin, This issue relates to the failure of the TVTS scan, which appears to have been addressed. The 3PL feedback that the scan result can successfully execute the MR process before 1/27. 3PL clearly states that R2 should only be considered if R1 cannot be tested. We recommend adopting the advice of 3PL. BR. Willin |
|
|
Hello Willin, TVTS 2.16_R1 can't be executed today. 01-13 17:47:08 E/TestInvocation: Expected Version Code higher then "242835116" but found "242632116" for Package: com.google.android.gms Please update the application and run TVTS [SKBFXYWR0LXP sequoia:bfx-ua300 QT] com.android.tradefed.targetprep.TargetSetupError: Expected Version Code higher then "242835116" but found "242632116" for Package: com.google.android.gms Please update the application and run TVTS [SKBFXYWR0LXP sequoia:bfx-ua300 QT] I think it's controlled by server. Could you please give me an advice? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, Please login your GTVS beta program account and then check if you can update gms. If you can,update gms and then test again. If you cannot,please provide your account and we will try to apply for account permissions. About issue on 0002060#0017715,Google has not yet provided an effective response. BR. Willin |
|
|
Hello, Willin, I can test TVTS 2.16_R1 using GTVS beta program account 2026-01-07. But, I can't test TVTS 2.16_R1 using GTVS beta program account 2026-01-14 even though it's same firmware. I will wait the answer from Google. https://partnerissuetracker.corp.google.com/issues/472375506 Thank you. Sangmin Choi. |
|
|
Hi Sangmin, Can you update gms using GTVS beta program account ? BR. Willin |
|
|
Hello, Willin, No, there is no update for gms(Google Play services) even I use GTVS beta program account. You can see the attached images. Thank you. Sangmin Choi. screen01.png (136,694 bytes) screen02.png (150,507 bytes) screen03.png (160,526 bytes) screen04.png (78,673 bytes) |
|
|
Hello, Willin, Is there any update in https://partnerissuetracker.corp.google.com/issues/472375506 ? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, I just saw that Google has responded, but they did not address how to obtain the latest GMS for ATV10. Instead, they are requiring the use of ATV11 to ATV14 to apply the latest GMS. |
|
|
Hello, Willin, I got a feedback from Google TAM that https://partnerissuetracker.corp.google.com/issues/472375506 was generated at the public issue tracker. Is it right? If it's generated at the public issue tracker, please change it as private issue tracker. Thank you. Sangmin Choi. |
|
|
Hi Sangmin, In 2025, I submitted a private issue related to a weather icon. However, Google support suggested that I switch to public mode so that we could view the feedback. All Android-related inquiries are in public mode. Yesterday, I requested Google to assist us in modifying this issue ,and consulted with our 3PL contact. The 3PL conducted a review and determined that the issue does not contain sensitive information. Google support marked the issue as WAI, I am unable to modify the status and access level of this issue. Google support has yet to provide feedback on the messages sent. Later, I will create a new issue and ask other Google support personnel to take a look. BR. Willin image-6.png (217,872 bytes) |
|
|
Hello, Willin, I have a question. Is there any option to create ticket as private or public when you create a ticket ? |
|
|
Hi Sangmin, my previous description of the issue's permissions was inaccurate. The weather issue I created long ago was associated with the other components（material3, also the public level）, the Google support team has requested that it be changed to Android public. I do not have the permission to create any private issues. In the future, new issues will be submitted via 3PL While their permissions allow for the private option, only users on the cc_list will be able to view the content. image-8.png (253,825 bytes) |
|
|
Hi Willing Deng, Could you explain current status to 3PL for getting waiver ? If you need something for waiver, let us know. I will prepare it. Thanks. |
|
|
Hi Sangmin, send us a copy of the TVTS log. I need to locate the FW fingerprint and Test Suite information for the waiver application. BR. Willin |
|
|
Hello, Willin Deng, Please check the attached log files. The fingerprint is SKB/BFX_UA300/BFX-UA300:10/QT/19.561.1-20260311:user/release-keys. Thank you. Sangmin Choi. |
|
|
Hello, Willin Deng, Uploaded result also. Thank you. Sangmin Choi. |
|
|
Hello, Willin Deng, Please check the attached result and log files. It was generated using TVTS 2.17_R1. Thank you. Sangmin Choi. |
|
|
Hello, Willin Deng, Attached files are the log, result and bugreport you asked. Thank you. Sangmin Choi. |
|
|
Hi Sangmin, wavier issue send to google ,url:https://issuetracker.google.com/495955429. the issue id(472375506) is deleted, now it's access denied. BR. Willin |
|
|
Hi Sangmin: Google's suggestion is to update GMSCore via the Play Store, then try TVTS again. Please confirm whether GMS Core can be updated now. BR. Willin. |
|
|
Hello, Willin Deng, I tested 2 times, but there is no com.google.android.gms update. adb shell dumpsys package com.google.android.gms | grep -i versioncode versionCode=242632116 minSdk=21 targetSdk=34 adb shell dumpsys package com.google.android.gms | grep -i versioncode versionCode=242632116 minSdk=21 targetSdk=34 I attached bug report also, please check it. Thank you. Sangmin Choi. account.png (71,664 bytes) no_update_available.png (105,139 bytes) |
|
|
Hello, Willin Deng, Is there any update for this ticket ? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, The 3PL is pushing Google to resolve the GMS version compatibility issues for Android Q (OS 10). BR. Willin shared image.png (92,408 bytes) |
|
|
Hi Sangmin, Google recommends that we test the GTVS version of the following URL on Android 10: https://android-build.corp.google.com/build_explorer/branch_dashboard/git_main-tvts-release/build_id/P121792671/ If testing is successful, please share the results. If the test fails, also provide a bug report and any relevant information for feedback to Google. BR. Willin. |
|
|
Hello, Willin Deng, I have no permission the URL you shared. Could you please provide me the packages ? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, We have consulted with the 3PL regarding account issues and are awaiting a response. BR. Willin |
|
|
Hello, Willin Deng, I tested using arm_android-tvts-15246748.zip, but the test can't be started. 04-22 10:09:01 E/TestInvocation: Expected Version Code higher then "242835116" but found "242632116" for Package: com.google.android.gms Please update the application and run TVTS [SKBFXYWR0LWD sequoia:bfx-ua300 QT] I updated all apps through Google Play Store, but the com.google.android.gms is not updated. adb -s SKBFXYWR0LWD shell dumpsys package com.google.android.gms | grep -i versioncode versionCode=242632116 minSdk=21 targetSdk=34 I attached the screenshot of Google Play Store upgrade menu and test results, logs. Thank you. Sangmin Choi. GooglePlayStore_20260422.png (108,886 bytes) |
|
|
Hi Sangmin, google release a new version, please re-verify with this build availble in drive link: https://drive.google.com/file/d/1e7hFQD7vDt7mUuu85CqcOHW07TqRCOld/view?usp=sharing BR. Willin |
|
|
Hello, Willin Deng, https://drive.google.com/file/d/1e7hFQD7vDt7mUuu85CqcOHW07TqRCOld/view?usp=sharing TVTS / 2.17_r1 / eng.saicha I can run the TVTS using this tool. Can I run the TVTS for the next self MR test ? Could you please get an official answer from 3PL ? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, the 3PL requires you to provide the test logs for this tool. BR. Willin |
|
|
Hello, Willin Deng, I think the TVTS tool you shared is built for ARM64. $ aapt dump badging testcases/voiceplatzchen.apk | grep native-code native-code: 'arm64-v8a' BFX-UA300 use ARM build tool. Could you please check it again? Thank you. Sangmin Choi. 스크린샷 2026-04-24 오후 5.16.59.png (27,877 bytes) |
|
|
Hi Sangmin, According to Google's response, the following recommendations are provided: 1. test using TVTS 2.17R1(14) and complete the entire process. 2. re-run the error entries from the above steps individually. 3. re-run the error entries from the above steps using the daily build. The official Google version 2.17R1 (android-tvts-2.17r1-arm-14928559.zip) and the latest daily build (android-tvts-2.17r1-arm-15298624.zip) will upload to FTP server; please follow the steps to re-run. the md5sum of files (dir: tvts/os10): 3cfb165d300358eefe8ba04ef2eed24e android-tvts-2.17r1-arm-14928559.zip 5368a932db5220c64acab1f175132db0 android-tvts-2.17r1-arm-15298624.zip BR. Willin |
|
|
Hello, Willin Deng, Tested TVTS 2.17_R1(14928559) Tests Passed 725 Tests Failed 1 Modules Done 33 Modules Total 34 TvConcurrentMediaPlaybackHostTestCases is not completed. TvConcurrentMediaPlaybackHostTestCases can be done using TVTS 2.14_R1. Could you please check it? Thank you. Sangmin Choi. Attached test results TVTS_2.17_R1_14928559_full.zip TVTS_2.17_R1_14928559_TvConcurrentMediaPlaybackHostTestCases.zip TVTS_2.14_R1_TvConcurrentMediaPlaybackHostTestCases.zip |
|
|
Hi Sangmin, Google has suggested that when we encounter issues, we should run the error case again using the latest daily build tool. Please check the status of running this error case separately with the tool(android-tvts-2.17r1-arm-15298624.zip). If that doesn't work, we can consult with 3PL for further assistance. the Google Info TvConcurrentMediaPlaybackHostTestCases: Enhanced test flexibility by allowing specified codec combinations for playback tests using the `--module-arg TvConcurrentMediaPlaybackHostTestCases:set-option: codec_combination:` option. This supports combinations of 1 to 4 codecs. The specific files deleted are those with the name /data/misc/perfetto-traces/*.pftrace Example: --module-arg TvConcurrentMediaPlaybackHostTestCases:set-option: codec_combination:AVC-VP9-AV1-HEVC This code will configure the PIP codec as AVC. The codec and PIP options can be used together. TvConcurrentMediaPlaybackHostTestCases:set-option:pip_codec:AVC Enabled the use of software codecs for PIP playback. The latest version (android-tvts-2.17r1-arm-15352644.zip) is still downloading and is expected to be uploaded by around 6~7 PM today. Meanwhile, there is a version of the tool downloaded from the FTP server at the end of April; I recommend that you first follow Google's suggestion and run the failed case test separately. BR. Willin image-9.png (73,656 bytes) |
|
|
Hello, Willin Deng, I tested using TVTS 2.17_R1(15298624), but the test results are same. tvts-tf > l r Session Pass Fail Modules Complete Result Directory Test Plan Device serial(s) Build ID Product 0 8 0 0 of 1 2026.05.06_10.40.21 tvts-maint-cert [SKBFXYWR0LWD] QT BFX_UA300 1 0 0 0 of 1 2026.05.06_13.53.10 tvts-maint-cert [SKBFXYWR0LWD] QT BFX_UA300 session 0 run tvts-maint-cert -m TvConcurrentMediaPlaybackHostTestCases session 1 run tvts-maint-cert -m TvConcurrentMediaPlaybackHostTestCases --module-arg TvConcurrentMediaPlaybackHostTestCases:set-option:codec_combination:AVC-VP9-AV1-HEVC Could you please check it ? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, This appears to be a known issue with Google, described as follows (https://docs.partner.android.com/tv/test/tvts/release-notes?hl=en): TvConcurrentMediaPlaybackHostTestCases: "To optimize test duration, some tests within this module are expected to be marked as IGNORED (as ASSUMPTION_FAILURE) if not applicable to the device's hardware configuration, resulting in an EXPECTED_TESTS_MISMATCH and a potential done=false status in the report because fewer tests run than the total parameterized count. A fix to improve the reporting mechanism is targeted for the TVTS 2.18 release. Note: This status does not block APFE approval for the device." It seems that this is not a problem for APFE (Android Partner Front End) BR. Willin image-10.png (54,489 bytes) |
|
|
Hello, Willin Deng, So, can I use android-tvts-2.17r1-arm-14928559.zip for self MR of SWAN ? Thank you. Sangmin Choi. |
|
|
Hi Sangmin, Yes,I think so, the "TvConcurrentMediaPlaybackHostTestCases" done with "false" is error-free, as the only message is that the actual count of test items is lower than expected. BR. Willin image-11.png (106,550 bytes) |
|
|
Hello, Willin Deng, Okay, I will close this ticket now. Thank you. Sangmin Choi. |
|
|
Hello, Willin Deng, I could run TVTS using android-tvts-2.17r1-arm-14928559.zip at 2026-05-06. But, today I can't run TVTS with below messages. 07-28 16:59:16 E/TestInvocation: Expected Version Code higher then "242835116" but found "242632116" for Package: com.google.android.gms Please update the application and run TVTS [SKBFXYWR0LXT sequoia:bfx-ua300 QT] com.android.tradefed.targetprep.TargetSetupError: Expected Version Code higher then "242835116" but found "242632116" for Package: com.google.android.gms Please update the application and run TVTS [SKBFXYWR0LXT sequoia:bfx-ua300 QT] I think it's related with Google server. Could you please check it ? Thank you. Sangmin Choi. |
|
|
Hi Sanming, We recommend trying out the new version of TVTS. The official version 2.18r1 is available on FTP, and the daily build: "arm-android-tvts-15967482.zip," both of which can be tested. BR. Willin |
|
|
Hello, Willin Deng, I can pass 2.18_r1 official tool and arm-android-tvts-15967482.zip in the FTP server. Thank you for support. Best Regards, Sangmin Choi. |
- yk.jung ( (ALTech) Younkwang Jung ) developer
